Deep Equilibrium Models for Snapshot Compressive Imaging
نویسندگان
چکیده
The ability of snapshot compressive imaging (SCI) systems to efficiently capture high-dimensional (HD) data has led an inverse problem, which consists recovering the HD signal from compressed and noisy measurement. While reconstruction algorithms grow fast solve it with recent advances deep learning, fundamental issue accurate stable recovery remains. To this end, we propose equilibrium models (DEQ) for video SCI, fusing data-driven regularization convergence in a theoretically sound manner. Each model implicitly learns nonexpansive operator analytically computes fixed point, thus enabling unlimited iterative steps infinite network depth only constant memory requirement training testing. Specifically, demonstrate how DEQ can be applied two existing SCI reconstruction: recurrent neural networks (RNN) Plug-and-Play (PnP) algorithms. On variety datasets real data, both quantitative qualitative evaluations our results effectiveness stability proposed method. code are available at: https://github.com/IndigoPurple/DEQSCI.
منابع مشابه
Single disperser design for compressive, single-snapshot spectral imaging
Recent theoretical work in “compressed sensing” can be exploited to guide the design of accurate, single-snapshot, static, high-throughput spectral imaging systems. A spectral imager provides a three-dimensional data cube in which the spatial information of the image is complemented by spectral information about each spatial location. In this paper, compressive, single-snapshot spectral imaging...
متن کاملSingle and multiple snapshot compressive beamforming
For a sound field observed on a sensor array, compressive sensing (CS) reconstructs the directionof-arrivals (DOAs) of multiple sources using a sparsity constraint. The DOA estimation is posed as an underdetermined problem expressing the acoustic pressure at each sensor as a phase-lagged superposition of source amplitudes at all hypothetical DOAs. Regularizing with an l1-norm constraint renders...
متن کاملMultiple and single snapshot compressive beamforming.
For a sound field observed on a sensor array, compressive sensing (CS) reconstructs the direction of arrival (DOA) of multiple sources using a sparsity constraint. The DOA estimation is posed as an underdetermined problem by expressing the acoustic pressure at each sensor as a phase-lagged superposition of source amplitudes at all hypothetical DOAs. Regularizing with an ℓ1-norm constraint rende...
متن کاملSparsity Models for Hyperspectral Imaging and Compressive Sensing LIDAR
Virtually all types of imaging (including remote sensing) deal with high-dimensional signals that have low-dimensional structure that can be exploited. While classic models rely only on signals being bandlimited, more recent signal models are based on the notion that most signals can be written as a sum of just a few elements from a suitable dictionary (known as "sparsity"). Sparsity models hav...
متن کاملA Hybrid Optimization Algorithm for Learning Deep Models
Deep learning is one of the subsets of machine learning that is widely used in Artificial Intelligence (AI) field such as natural language processing and machine vision. The learning algorithms require optimization in multiple aspects. Generally, model-based inferences need to solve an optimized problem. In deep learning, the most important problem that can be solved by optimization is neural n...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Proceedings of the ... AAAI Conference on Artificial Intelligence
سال: 2023
ISSN: ['2159-5399', '2374-3468']
DOI: https://doi.org/10.1609/aaai.v37i3.25475